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In noncommutative probability theory independence can be based on free products 
instead of tensor products. This yields a highly noncommutative theory: free probability 
(for an introduction see [9]). The analogue of entropy in the free context was introduced 
by the second named author in [8] . Here we show that Shannon's entropy power inequality 
([6],[1]) has an analogue for the free entropy x{^) (Theorem 2.1). 

The free entropy, consistently with Boltzmann's formula S = k log W, was defined via 
volumes of matricial microstates. Proving the free entropy power inequality naturally 
becomes a geometric question. 

Restricting the Minkowski sum of two sets means to specify the set of pairs of points 
which will be added. The relevant inequality, which holds when the set of addable points is 
suflBciently large, differs from the Brunn-Minkowski inequality by having the exponent 1/n 
replaced by 2/n. Its proof uses the rearrangement inequality of Brascamp-Lieb-Liittinger 
([2]). Besides the free entropy power inequality, note that the inequality for restricted 
Minkowski sums may also underlie the classical Shannon entropy power inequality (see 3.2 
below) . 

Acknowledgments. Part of this work was done while the first named author was 
visiting Universite Paris VI and Universite Marne la Vallee in May- July 1995. The second 
named author worked on this paper while visiting MIT and IHES in 1995. The authors 
express their gratitude to these institutions for their hospitality and support. 

1. The inequality for restricted Minkowski sums. li A,B C R" (or any vector 
space) , the Minkowski sum of A and B is defined by 

A + B = {x + y: {x,y) e A X B} . 

An important property of the Minkowski sum in is the Brunn-Minkowski inequality 

([4], [5]) 

X{A + S)^/" > A(A)i/'^ + A(S)i/'^ 

where A denotes n-dimensional Lebesgue measures. We introduce a modified concept of a 
sum. 
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1.1 Definition. Let A, B be subsets of a vector space and Q G A x B. We will call 



A+eB = {x + y: {x,y)eQ} 

the restricted (to 0) sum of A and B. 

We then have the following inequality (in what follows, all sets and functions are assumed 
to be measurable; A denotes the Lebesgue measure in the appropriate dimension that may 
vary from place to place). 

1.2 Theorem. Let p e (0, 1), n eN and let A,B be such that 

Furthermore, let & <Z A x B <Z M^" be such that 

A(e) > (1 - cmin{pVn, 1})X{A)X{B) . 

Then 

(1.1) X{A +e S)2/- > A(A)2/- + A(S)2/" . 

(c > is a numerical constant, independent of e, n, A, B and Q.) 

The following simple but illuminating example shows that, in general, one cannot expect 
a significantly stronger assertion: let B^ be the Euclidean ball in W^, A = B^, B — pB^ 
and O ^ {{x,y) e A X B : {x,y) < 0}. Then 

(1) A(G) = |A(^)A(S) 

(2) ^+e5= (l + p2)i5n 

and we have equality in (1.1). We now state a lemma which is an elaboration of this 
example 

1.3 Lemma. Let p,n be as in Theorem 1.2 and let 

Q = {{x,y):x,yeW\\x\<l, \y\<p, \x + y\ < {1 + p'f^} 



Then 

A(e) < (1 - cmin{pv^, l})A(S")A(pS'^) , 

where c > is a universal constant. 

We postpone the proof of the lemma (which depends on a careful, but completely- 
elementary computation) and show how it implies the theorem. We observe first that 
Lemma 1.3 yields the following special case of the theorem 

(1.2) ^ = piS", S = p25^, e = {ix,y)eAxB:x + yeRB''} 

where pi,p2,R > are arbitrary constants. The case pi — 1, p2 — p < 1 follows directly 
and the general one by symmetry and homogeneity. 

The strategy for the rest of the proof is now as follows: if Aq, Bq C M"^ and Oq C AqxBq, 
we will show that there are A, B, of the form (1.2) verifying 

(i) A(^o) = A(^), X{Bo) = X{B) 

(ii) A(e)>A(eo) 

(iii) XiA +G B) < X{Ao +Go Bo) 

Now if the original Ao,Bo,Qo had yielded a counterexample to the theorem, the corre- 
sponding A, B, Q would have, a fortiori, worked as such, contrary to the remark following 
Lemma 1.3. Accordingly it remains to realize (i)-(iii) for given -^o, ©o- 

Step 1. Set C — Aq Bq and 

Oi = {{x, y)eAoxBo:x + yeC}, 

then Aq Bq — Aq -Bo, while clearly A(0i) > A(0o)- 

Step 2. Define pi,p2,R> via 

A(Ao) = A(pii?-) , A(i?o) = A(p2S") , X{C) = X{RB^) . 

We then have 

A(ei) = X{{{x, y) e ylo X So : a; + y e C}) 



XAo {x)xBo {y)xc{x + y)dxdy 

(1.3) -'Y -'Y 

< / XpiBr'-{x)xp2Br^{y)xRBr^{x + y)dxdy 



= A({(x, y) e piS" X p^B"^ -.x + ye RB^}) 
4 



as required for (i)-(iii) (and concluding the derivation of Theorem 1.2 from Lemma 1.3). 
The inequahty in (1.3) is a special case of [2, Theorem 3.4], which, in a much more general 
setting, estimates an integral of a product of nonnegative functions by that of their spherical 
(or Schwartz) symmetrizations; we thank Alain Pajor for pointing the paper [2] to us. 

□ 

Proof of Lemma 1.3 (Sketch). We will show that, for an appropriate choice of ci > 
and with t = | mm{p^/n, 1}, one has 

(1.4) 1 > |a;o| > 1 - r/n ^ A({y : |y| < p, |a;o + y| > (1 + p^)H) > ciA(pS") 

It then follows that 

A(S" X pS^\e) > (1 - T/n)"ciA(S") • A(pS^) 

and that clearly implies the lemma. To show (1.4), we denote tq = \xo\ and assume, as we 
may, that = (ro, 0, . . . , 0) and n >2. Then (the reader is advised to draw a picture) 

\{y: \y\ < p, |a;o + y| < (l + p^)^}] 

= • (^J {p'^ - u^)"^ du + (1 + P^ - {ro + uf)'^du^ 

where s = (1 - r^)/2ro and t = (1 + p^)! - tq. Since s < (r/n) ■ (1 + ^) < (p/v^)(l + 
0(n~^)), the contribution of the first integral constitutes a proportion of \{pB^) that 
is strictly smaller than 1 (uniformly in n) and asymptotically, as n — > oo, is of order 
$(1) • \{pB'^), where $ is the c.d.f. of a standard A'"(0, 1) Gaussian random variable. 
Similarly, the contribution of the second integral is shown to be o(l) ■ X{pB^) as n — > cxo 
(or, more exactly, less than (p/s/n) ■ \{pB^) for all n > 2); we omit the rather routine 
details. Combining the two estimates yields (1.4), hence Lemma 1.3. 

1.4 Remark. Theorem 1.2 is optimal in the following sense: there exist constants 

a,A>Q such that, for any n e N (resp. for any n e N, p e (0, 1)), there exist A,B eW- 

(resp. with p < (A(5)/A(^))V^ < p-i) and 6 C ^ x S with A(e) > a\{A)\{B) (resp. 

A(0) > (1 — Apn^)\{a)\{B)) such that the assertion of the theorem does not hold. 
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1.5 Corollary. There exist c,C > such that, for any 6 e [0,c], n E N, any ^, 5 C R" 

and any Q G Ax B with A(0) > (1 - 6)X{A)X{B) one has 

(1.5) X(A +© m^/^ > (1 - —){X(Af/^ + A(S)2/^) 

n 

Proof. We may assume that A(^) = 1 > X(B) = p". Let c > be one given 
by Theorem 1.2; we may clearly assume that c < 1/2. If p > 5/(cy^), we may apply 
Thoerem 1.2 and get the assertion, in fact without the factor (1 — ^). On the other hand, 
regardless of the size of p one has (just by Fubini's theorem), 

X{A +e B)>{l-6)X{A) = l-5, 

hence 

A(^+e Bf/^>1--, 

n 

and it is easy to check that, for an appropriate choice of C, the right-hand side of (1.5) 
does not exceed the latter quantity if p < 5/ (cy^). 

1.6 Remark. Redoing the argument of Theorem 2.1 in the context of Corollary 1.5 
(rather than formally applying the assertion of the theorem) does not produce a sharper 
result. However, it is possible to obtain an assertion similar to that of Corollary 1.5 under 
much weaker assumptions, namely, in the notation of Theorem 1.2, if 7 e (0,1) then 
the condition A(0) > ^X{A)X{B) implies a version of (1.5) with (1 — C5/n) replaced by 
(l-Cp(log(l + l/7)/n)^). 

2. The free entropy power inequality 

The free entropy xi^ii ■ ■ ■ )^n) for an n-tuple of selfadjoint elements Xj e M, M a 
von Neumann alegbra with a normal faithful trace state r, was defined in [8] part II. 
The definitionn involves sets of matricial microstates Tji{Xi, . . . , X^, m, k, s) (see §2 in [8] 
part II). The microstates are points in (TVl^")"^, where M%°' denotes the selfadjoint k x k 
matrices. A will denote Lebesgue measure on (A^^")"^ corresponding to the euclidean norm 

\\{A^,...,A^)\\j,s^TriAi + ... + Al) . 
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For one random variable we have (Prop. 4.5 in [8] part II) that: 



(2.1) 



\og\s - t\dii{s)dii{t) + ^ + |log27r 



where fj, is the distribution of X (see 2.3 in [9]) or equivalently the measure on R obtained 
by applying the trace r to the spectral measure of X. 

2.1 Theorem. Let X,Y e M , X = X* , Y = Y* and assume X, Y are free. Then 



Using the explicit formula for x(^) cind the fact that the distribution of the sum of 
two free random variables is obtained via the free convolution ffl (see 3.1 in [9]) there is an 
equivalent form of the preceding theorem. 

2.1' Theorem. Let a,P be compactly supported probability measures on M. Then 



Proof of Theorem 2.1 The proof will be technically similar to sections 4 and 5 of 
[8] part II. Let Z e M, Z = Z* distributed according to Lebesgue measure on [0,1] and 
let Ui, U2 be unitaries with Haar distributions in (M, r) and assume Z, Ui, U2 are *-free. 
Let further /ii, /i2 : [0, 1] M be Ci-functions with h'^{t) > 0, h'^it) > for all t G [0, 1]. 
Remark that it suffices to prove the theorem in case X — Uihi{Z)Ui , Y = U2h2{Z)U2 
(i.e., the distributions of X and Y are the push-forwards by hi and h2 of Lebesgue measure 
on [0, 1]). Indeed see 2° in the proof of Proposition 4.5 in [8] part II) there are sequences 
hj^n of functions as above, such that 



(2.2) 



exp(2x(X)) + exp(2x(F)) < exp(2x(X + Y)) . 



(2.3) 



exp(2 




hm x{Uthi,n{Z)Ul) 



X{X) 



hm x{U2h2,n{Zm) 



X{Y) 



and \\hj 



'j,n ||oo 



< R for some fixed constant R. Then 



Uihi,n{Z)U^ + U2h2,n{Zm\\ < 
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and Uihi^n{Z)Ui + U2h2,n{Z)U2 converges in distribution to X + Y because of our freeness 
assumptions. By 2.6 in [8] part II we have 

limsupx(C/i/ii,n(^)C^r + U2h2,niZ)U^) < xi^ + Y) 

n— >oo 

and hence it suffices to prove Theorem 2.1, in case X = Uihi{Z)Ui , Y = U2h2{Z)U2 ■ 
Like in 5.3 of [8] part II, let 

n{hj;k) = {Ae Mi"" \ hj(2s/2k) < A,+i(^) < hj{{2s + l)/2k),0 < s < A; + 1} 

where Xi{A) < ■ ■ ■ < Xk{A) are the eigenvalues of A. The last part of the proof of 
Proposition 4.5 in [8] part II shows that 

(2.4) lim {k-^ log X{n{hj;k)) + 2-^ log k) = x{hj{Z)) 

where A is the Lebesgue measure on A4%"'. 
Let further N and £ > be given and 

e(A;) = {{Ai, A2) e n ^{hj;k) \ {Ai, A2) e T{Uihi{Z)U^, f/2/i2(Z)C/*; N, k, e)} 

i<i<2 

By Lemma 5.3 in [8] part II we have: 

(26) lim = 1 

^ ■ ^ fe-00 X{Q{hi;k) X Q{h2;k)) 

If -R > \\hj lloo then 

Q{k) cTR{Uihi{Z)U^,U2h2{Z)U^; N,k,e) . 
Further, given Ni eN, £1 > we may choose N eN, e > so that 

{Ai,A2) eTRiU^h^iZ)U*,U2h2iZ)U^; N,k,s) 

implies 

A^ + A2eT2RiU^h^iZ)U^ + U2h2iZ)U^; N,k,s) . 

In particular, 

(2.7) n{hi-k) +eik)^{h2;k) cT2R{U^hi{Z)U^ + U2h2{Z)U;- N^,k,ei) . 



Using Theorem 1.2 for k > ko with ko sufficiently large, taking into account (2.6), we have 
(A(17(/ii;A;)))2/'=' + (A(f](/i2;A;)))'/'' < iXiT2RiU,h,iZ)U* + U2h2iZ)U^; N,,k,e,))f/>'" . 



Given 5 > we may choose ko, Ni large and Si small, so that 

k-HogX{T2R{Uihi{Z)U^ + U2h2{Z)U;; Ni,k,ei) + |logA; 
< x{Uihi{Z)Ul + U2h2{Z)U^) + 5 

for all k > ko- 

We infer that for k > ko, 

exp(2fc-^(log A(f2(/ii; k)) + 2'^ \ogk) + exp(2A;-^(log A(n(/i2; k)) + 2"^ logfc) 
< exp(2(x(C/i/ii(Z)f/* + U2h2{Z)U*) + 5)) . 

Letting /c — > oo and taking into account that 5 > was arbitrary, we get the desired 
inequality. □ 

3. Concluding remarks and open problems 

3.1 The free entropy power inequality for n-tuples. To extend Theorem 2.1 to 
n-tuples of non-commutative random variables means to prove 

(3.1) exp(-x(Xi, . . . , Xr,)) + exp(-x(yi, • • • , i;,)) < exp(-x(Xi + Yi, . . . , X„ + y„)) 
n n n 

under the assumption that {Xi, . . . , X^} and {Yi, . . . , F„} are freee. The missing ingredient 

at this time is the generalization of section 5 in [8] part II to n-tuples. The rest of the 

argument, i.e. the use of Theorem 1.2, would then be along the same lines as for n = 1. 

At present, partial generalizations of Theorem 2.1 can be obtained. The route to be 

followed is: first replace X and Y by n-tuples (Xi, . . . , X^), (li, . . . , Y^) such that the 2n 

variables Xi, . . . , X„, Yi, . . . , F„ are free and note that in this situation the necessary facts 

about sets of matricial microstates can be obtained from section 5 of [8] part II. Then the 

generalization of Theorem 2.1 will hold for n-tuples (Fi (Xi, . . . , X„), . . . , F„(Xi, . . . , X„)) 

and {Hi{Yi, . . . ,Yn), . . . , Hn{Yi, . . . ,Yn)) where Xi, . . . , X^, Yi, . . . , Y^ are free and 
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{Fi, . . . , Fn),{Hi, . . . , Hn) are non-commutative functions satisfying suitable conditions, 
like the existence of an inverse of the same kind and extending to the matricial microstates. 
These kind of extensions have statements containing many technical conditions, the proof, 
except for some technicalities, being along the same lines as for n = 1. We don't pursue this 
here, hoping that better techniques will yield a proof of the free entropy power inequality 
in full generality. 

3.2 Shannon's classical entropy power inequality and restricted Minkowski 
sums. We would like to signal that the inequality in Theorem 1.2 has the potential to 

provide a proof also of Shannon's classical entropy power inequality. The reason is that 
the classical entropy of an n-tuple of commutative random variables can be defined via 
microstates (using the diagonal subalgebra of n x n matrix algebra instead of the full 
algebra) and the entropy power inequality would then correspond to the same kind fo 
geometric problem at the level of microstates as in the free case. We are thinking of 
exploring this possibility in future work. 

3.3 The free analogue of the Stam inequality. It seems natural to look also 
for a free analogue of the Stam inequality ([7], see also [1],[3]), of which the free entropy 
power inequality would be a consequence. With $ denoting the free analogue of Fisher's 
information measure (see [8] part I) this would amount to: 

mx + y))-i < ($(x))-i + ($(y))-^ 

if X, Y are free. 
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